Papers with failure mechanism
Format Inertia: A Failure Mechanism of LLMs in Medical Pre-Consultation (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models have brought significant improvements to various service domains, including chatbots and medical pre-consultation applications. |
| Approach: | They propose a method that rebalances the turn-count distribution of training data to mitigate Format Inertia in medical pre-consultation tasks. |
| Outcome: | The proposed method significantly alleviates Format Inertia in medical pre-consultation tasks. |
JPU: Bridging Jailbreak Defense and Unlearning via On-Policy Path Rectification (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are vulnerable to diverse jailbreak attacks despite extensive safety alignment . |
| Approach: | They propose a method to rectify dynamic jailbreak paths towards safety anchors by dynamically mining on-policy adversarial samples to expose vulnerabilities and identify jailbreak path. |
| Outcome: | The proposed model significantly improves jailbreak resistance against dynamic attacks while maintaining its utility. |